Below is a summary of what we found when checking the rsid report suite looking at data from start_date to end_date
Note: The raw data for everything that follows is available in [this Google Sheet].
This is an R Markdown document. Markdown is a simple formatting syntax for authoring HTML, PDF, and MS Word documents. For more details on using R Markdown see http://rmarkdown.rstudio.com.
ggplotly(c1)
ggplotly(r1)
ggplotly(top10)
ggplotly(bot10)
top10 + bot10
ggplotly(highlow_count)
ggplotly(sl1)
ggplotly(sl2)
ggplotly(sl3)
The following are some highlights.
Top 10 Good Bad
Number of Journeys Higher or Lower than Baseline
Dumbbell plots Parallel Plot - Top 10 good/bad
Most common user journeys though the website
How are Entry journeys affected by the changes
Device journeys and any gaps
Journeys grouped by their category and measures
Below is a summary of the website journeys looking at data from 2021-08-11 to 2022-02-06. This table is sorted by the difference between the baseline and the new site baseline difference percentage. Higher performing new journeys should come to the top while worst performing journeys should be at the bottom.
| Journey Name | Baseline Visits | New Site Visits Avg. | % Visits Diff. |
|---|---|---|---|
| Home to Shop | 1562 | 1671 | 7.0% |
| Commercial: Shop Checkout Steps 1-4 | 361 | 577 | 59.8% |
| Holidays Entry | 2446 | 2993 | 22.4% |
| Shop Entry | 4443 | 5192 | 16.9% |
| Members Area Entry | 1341 | 1218 | -9.2% |
| Home to Donate Form | 128 | 117 | -8.6% |
| Days Out to Property Page | 5857 | 2781 | -52.5% |
| Home to Days Out | 8110 | 3995 | -50.7% |
| Home to Search Results | 6032 | 3036 | -49.7% |
| Days Out to Places Map | 5621 | 2996 | -46.7% |
| Days Out Entry | 2618 | 1422 | -45.7% |
| Days Out to Places Search | 14517 | 8027 | -44.7% |
| Homepage Entry | 24151 | 14232 | -41.1% |
| ALL Tablet | 13270 | 8482 | -36.1% |
| Property Page Seen | 122444 | 79812 | -34.8% |
| ALL Repeat Visitors | 91320 | 59793 | -34.5% |
| Home to Join | 3376 | 2254 | -33.2% |
| ALL Android | 54763 | 36872 | -32.7% |
| ALL Direct Traffic | 24056 | 16696 | -30.6% |
| ALL Social | 1802 | 1731 | -3.9% |
| ALL Natural Search | 120107 | 84217 | -29.9% |
| ALL Main Site | 169734 | 119081 | -29.8% |
| ALL Mobile | 122831 | 86539 | -29.5% |
| ALL Visits | 184044 | 129983 | -29.4% |
| ALL PPC | 17792 | 12678 | -28.7% |
| ALL Apple iOS | 81314 | 58079 | -28.6% |
| ALL Affiliates | 1759 | 1257 | -28.5% |
| ALL SEO | 117307 | 84283 | -28.2% |
| Home to Art | 253 | 182 | -28.1% |
| Home to Our Cause | 552 | 398 | -27.9% |
| ALL Desktop | 47911 | 34941 | -27.1% |
| Home to Holidays | 1058 | 776 | -26.7% |
| ALL Email | 11358 | 8367 | -26.3% |
| Home to Support | 337 | 249 | -26.1% |
| ALL Holidays | 10953 | 8103 | -26.0% |
| Join Us Entry | 13930 | 10411 | -25.3% |
| ALL New Visitors | 92724 | 70190 | -24.3% |
| ALL Paid Social | 3158 | 2470 | -21.8% |
| ALL Shop | 8994 | 7547 | -16.1% |
Below is the detail behind each journey and main traffic metrics for each journey.
| Journey Name | Journey Type | Visits Avg. | Page Views Avg. | UV Avg. | Bounces Avg. | Avg. Time on Site | Avg. % New Visits | Avg. % Repeat Visits | Avg New Visits | Avg. Repeat Visits |
|---|---|---|---|---|---|---|---|---|---|---|
| ALL Affiliates | pre | 1759 | 7216 | 1570 | 527 | 363 | 53.8% | 46.1% | 969 | 789 |
| ALL Affiliates | post | 1257 | 5852 | 1114 | 344 | 377 | 55.9% | 44.1% | 701 | 555 |
| ALL Android | pre | 54763 | 168485 | 47412 | 21645 | 287 | 42.7% | 57.3% | 23269 | 31494 |
| ALL Android | post | 36872 | 118249 | 32467 | 14991 | 273 | 49.0% | 51.0% | 18014 | 18858 |
| ALL Apple iOS | pre | 81314 | 241978 | 68513 | 33820 | 276 | 63.1% | 36.9% | 51162 | 30153 |
| ALL Apple iOS | post | 58079 | 179124 | 49167 | 24800 | 266 | 66.4% | 33.6% | 38441 | 19638 |
| ALL Desktop | pre | 47911 | 215378 | 42644 | 14923 | 385 | 55.2% | 44.8% | 26409 | 21499 |
| ALL Desktop | post | 34941 | 156220 | 31358 | 11742 | 370 | 60.1% | 39.9% | 20967 | 13971 |
| ALL Direct Traffic | pre | 24056 | 75474 | 20940 | 9314 | 271 | 64.2% | 35.8% | 15448 | 8606 |
| ALL Direct Traffic | post | 16696 | 53175 | 14567 | 6981 | 269 | 66.2% | 33.8% | 11106 | 5588 |
| ALL Email | pre | 11358 | 44170 | 10184 | 4175 | 306 | 39.2% | 60.8% | 5536 | 5821 |
| ALL Email | post | 8367 | 31088 | 7445 | 3154 | 301 | 41.7% | 58.3% | 4172 | 4193 |
| ALL Holidays | pre | 10953 | 43495 | 9868 | 3187 | 361 | 55.4% | 44.6% | 6096 | 4857 |
| ALL Holidays | post | 8103 | 36249 | 7194 | 2326 | 394 | 58.2% | 41.8% | 4743 | 3361 |
| ALL Main Site | pre | 169734 | 531124 | 146385 | 65065 | 294 | 55.0% | 45.0% | 93083 | 76658 |
| ALL Main Site | post | 119081 | 372946 | 103890 | 47523 | 273 | 60.0% | 40.0% | 71315 | 47771 |
| ALL Mobile | pre | 122831 | 358517 | 104150 | 50986 | 269 | 55.2% | 44.8% | 67528 | 55305 |
| ALL Mobile | post | 86539 | 263780 | 74060 | 36768 | 259 | 59.7% | 40.3% | 51555 | 34984 |
| ALL Natural Search | pre | 120107 | 410758 | 103291 | 43406 | 326 | 52.1% | 47.9% | 62314 | 57796 |
| ALL Natural Search | post | 84217 | 293812 | 73283 | 32295 | 309 | 58.1% | 41.9% | 48859 | 35359 |
| ALL New Visitors | pre | 92724 | 318122 | 92724 | 32595 | 276 | 99.9% | 0.1% | 92617 | 100 |
| ALL New Visitors | post | 70190 | 248176 | 70190 | 25245 | 267 | 99.9% | 0.1% | 70122 | 63 |
| ALL Paid Social | pre | 3158 | 6687 | 3050 | 1894 | 193 | 70.7% | 29.3% | 2245 | 913 |
| ALL Paid Social | post | 2470 | 5481 | 2397 | 1341 | 186 | 72.6% | 27.4% | 1813 | 656 |
| ALL PPC | pre | 17792 | 81888 | 16082 | 6693 | 403 | 62.1% | 37.9% | 11056 | 6736 |
| ALL PPC | post | 12678 | 64524 | 11335 | 4171 | 411 | 63.0% | 37.0% | 8001 | 4677 |
| ALL Repeat Visitors | pre | 91320 | 307850 | 75690 | 37820 | 351 | 9.2% | 90.8% | 8262 | 83063 |
| ALL Repeat Visitors | post | 59793 | 205641 | 50067 | 26332 | 344 | 12.4% | 87.7% | 7379 | 52417 |
| ALL SEO | pre | 117307 | 420033 | 106708 | 39887 | 323 | 60.5% | 39.5% | 70714 | 46596 |
| ALL SEO | post | 84283 | 313519 | 77300 | 29574 | 307 | 66.2% | 33.8% | 55689 | 28595 |
| ALL Shop | pre | 8994 | 50826 | 8198 | 2106 | 285 | 53.9% | 46.1% | 4920 | 4075 |
| ALL Shop | post | 7547 | 44242 | 6809 | 1692 | 300 | 57.9% | 42.1% | 4374 | 3174 |
| ALL Social | pre | 1802 | 3704 | 1726 | 982 | 184 | 79.3% | 20.8% | 1432 | 370 |
| ALL Social | post | 1731 | 4156 | 1662 | 866 | 175 | 80.5% | 19.5% | 1403 | 328 |
| ALL Tablet | pre | 13270 | 51978 | 11800 | 4493 | 373 | 52.1% | 47.9% | 6920 | 6349 |
| ALL Tablet | post | 8482 | 33752 | 7644 | 3057 | 354 | 58.4% | 41.6% | 4963 | 3519 |
| ALL Visits | pre | 184044 | 625973 | 158576 | 70415 | 311 | 55.0% | 45.0% | 100879 | 83163 |
| ALL Visits | post | 129983 | 453817 | 113049 | 51576 | 299 | 59.7% | 40.3% | 77501 | 52479 |
| Commercial: Shop Checkout Steps 1-4 | pre | 361 | 5216 | 275 | NA | NA | NA | NA | NA | NA |
| Commercial: Shop Checkout Steps 1-4 | post | 577 | 7984 | 436 | NA | NA | NA | NA | NA | NA |
| Days Out Entry | pre | 2618 | 15929 | 1923 | 619 | 479 | 24.1% | 75.9% | 637 | 1980 |
| Days Out Entry | post | 1422 | 8912 | 1036 | 343 | 465 | 28.8% | 71.2% | 415 | 1007 |
| Days Out to Places Map | pre | 5621 | 39355 | 4294 | 1215 | 502 | 27.6% | 72.4% | 1568 | 4054 |
| Days Out to Places Map | post | 2996 | 22480 | 2320 | 642 | 492 | 34.0% | 66.0% | 1023 | 1974 |
| Days Out to Places Search | pre | 14517 | 102866 | 11323 | 3027 | 487 | 30.5% | 69.5% | 4468 | 10051 |
| Days Out to Places Search | post | 8027 | 60741 | 6336 | 1665 | 476 | 36.6% | 63.5% | 2945 | 5082 |
| Days Out to Property Page | pre | 5857 | 37288 | 4639 | 1112 | 466 | 29.1% | 70.9% | 1738 | 4119 |
| Days Out to Property Page | post | 2781 | 18720 | 2216 | 528 | 451 | 34.4% | 65.6% | 960 | 1821 |
| Holidays Entry | pre | 2446 | 14463 | 1895 | 597 | 513 | 27.4% | 72.6% | 676 | 1771 |
| Holidays Entry | post | 2993 | 17665 | 2411 | 742 | 493 | 34.6% | 65.4% | 1099 | 1895 |
| Home to Art | pre | 253 | 1928 | 189 | 49 | 596 | 32.2% | 67.8% | 81 | 172 |
| Home to Art | post | 182 | 1448 | 134 | 36 | 616 | 36.2% | 63.8% | 65 | 117 |
| Home to Days Out | pre | 8110 | 57776 | 6257 | 1662 | 500 | 27.0% | 73.0% | 2210 | 5901 |
| Home to Days Out | post | 3995 | 30511 | 3104 | 815 | 493 | 32.6% | 67.4% | 1307 | 2688 |
| Home to Donate Form | pre | 128 | 811 | 89 | 31 | 544 | 25.1% | 74.9% | 32 | 96 |
| Home to Donate Form | post | 117 | 843 | 78 | 28 | 684 | 25.7% | 74.4% | 30 | 88 |
| Home to Holidays | pre | 1058 | 8566 | 764 | 211 | 649 | 23.2% | 76.8% | 246 | 812 |
| Home to Holidays | post | 776 | 6616 | 556 | 157 | 679 | 26.9% | 73.1% | 209 | 567 |
| Home to Join | pre | 3376 | 21512 | 2500 | 794 | 506 | 31.2% | 68.8% | 1060 | 2316 |
| Home to Join | post | 2254 | 15053 | 1672 | 528 | 514 | 35.4% | 64.6% | 798 | 1457 |
| Home to Our Cause | pre | 552 | 3889 | 405 | 116 | 579 | 30.3% | 69.7% | 167 | 386 |
| Home to Our Cause | post | 398 | 2838 | 286 | 84 | 614 | 33.9% | 66.1% | 132 | 266 |
| Home to Search Results | pre | 6032 | 37970 | 4471 | 1364 | 482 | 24.7% | 75.3% | 1497 | 4536 |
| Home to Search Results | post | 3036 | 20624 | 2238 | 682 | 491 | 29.0% | 71.1% | 882 | 2154 |
| Home to Shop | pre | 1562 | 12922 | 1207 | 344 | 502 | 28.4% | 71.7% | 447 | 1116 |
| Home to Shop | post | 1671 | 14428 | 1282 | 353 | 504 | 31.6% | 68.4% | 541 | 1130 |
| Home to Support | pre | 337 | 2176 | 252 | 75 | 491 | 26.0% | 74.0% | 87 | 250 |
| Home to Support | post | 249 | 1796 | 188 | 50 | 561 | 31.3% | 68.7% | 77 | 172 |
| Homepage Entry | pre | 24151 | 122990 | 18776 | 7663 | 412 | 30.8% | 69.2% | 7455 | 16697 |
| Homepage Entry | post | 14232 | 78511 | 11127 | 4509 | 413 | 35.6% | 64.4% | 5063 | 9169 |
| Join Us Entry | pre | 13930 | 70529 | 11107 | 3422 | 378 | 36.4% | 63.6% | 5125 | 8806 |
| Join Us Entry | post | 10411 | 54754 | 8421 | 2442 | 372 | 43.0% | 57.0% | 4508 | 5903 |
| Members Area Entry | pre | 1341 | 5468 | 1141 | 423 | 435 | 17.2% | 82.8% | 339 | 1002 |
| Members Area Entry | post | 1218 | 4605 | 1050 | 400 | 429 | 23.3% | 76.7% | 412 | 807 |
| Property Page Seen | pre | 122444 | 423600 | 105766 | NA | NA | NA | NA | NA | NA |
| Property Page Seen | post | 79812 | 279634 | 69907 | NA | NA | NA | NA | NA | NA |
| Shop Entry | pre | 4443 | 26553 | 3619 | 1276 | 420 | 25.4% | 74.6% | 1315 | 3129 |
| Shop Entry | post | 5192 | 31336 | 4298 | 1406 | 413 | 28.4% | 71.6% | 1854 | 3338 |
Below is the count of anomalies detected for each journey, this is sorted by the number detected in the post launch period. Journeys higher up this list will need more investigation than lower journeys.
| Journey Name | Journey Description | No. of Anomalies (Post Launch) |
|---|---|---|
| Home to Search Results | Homepage to Search Results (Visitor Level) | 30 |
| Home to Support | Homepage to Support Us (Visitor Level) | 27 |
| Join Us Entry | First page of Visit is Join Us (Visitor Level) | 25 |
| Home to Art | Homepage to Art & Collections (Visitor Level) | 24 |
| Home to Join | Homepage to Join Us (Visitor Level) | 24 |
| Days Out Entry | First page of Visit is Days Out (Visitor Level) | 23 |
| Home to Holidays | Homepage to Holidays (Visitor Level) | 21 |
| Days Out to Property Page | Days Out to Property Page (Visitor Level) | 20 |
| Home to Our Cause | Homepage to Our Cause (Visitor Level) | 20 |
| Home to Shop | Homepage to Shop (Visitor Level) | 20 |
| Days Out to Places Map | Days out to Places Map (Visitor Level) | 19 |
| ALL Desktop | Device Type = Other (Desktop) | 18 |
| ALL New Visitors | Visit Number = 1 | 17 |
| ALL Visits | All site visits | 17 |
| Home to Days Out | Homepage to Days Out (Visitor Level) | 17 |
| ALL SEO | Visits from Search Engines | 16 |
| Members Area Entry | First page of Visit is Members Area (Visitor Level) | 16 |
| ALL Direct Traffic | Marketing Channel Direct Traffic Visits | 15 |
| ALL Tablet | Device Type = Tablet | 15 |
| Homepage Entry | First page of Visit is Homepage (Visitor Level) | 15 |
| ALL Paid Social | Marketing Channel Paid Social | 14 |
| Days Out to Places Search | Days Out to Places Search (Visitor Level) | 14 |
| Holidays Entry | First page of Visit is Holidays (Visitor Level) | 14 |
| Home to Donate Form | Homepage to Donate Form (Button) (Visitor Level) | 14 |
| Property Page Seen | A property home page was viewed | 14 |
| ALL Main Site | Site Section = Main Site | 13 |
| ALL Shop | Site Section = Shop | 13 |
| ALL Email | Marketing Channel Email | 12 |
| ALL Natural Search | Marketing Channel Natural Search Visits | 12 |
| ALL Repeat Visitors | Visit Number > 1 | 12 |
| ALL Social | Marketing Channel Social Visits | 12 |
| ALL Android | Operating system = Android | 11 |
| ALL Mobile | Device Type = Mobile | 11 |
| ALL Apple iOS | Operating System = Apple iOS | 10 |
| Commercial: Shop Checkout Steps 1-4 | Steps 1 to 4 of checkout funnel | 9 |
| ALL Holidays | Site Section = Holidays | 6 |
| Shop Entry | First page of Visit is Shop (Visitor Level) | 5 |
| ALL PPC | Marketing Channel Paid Search Visits | 4 |
| ALL Affiliates | Marketing Channel Affiliate Journey | 3 |
Baseline Dates: 2021-08-11 to 2021-11-08. Launch Dated (Red Line): 2021-11-09 to 2022-02-06.
## Forecast processing completed.
Shop daily funnel event stages 1 to 4. Comparison is based on a rolling Sunday to Sunday window. Hover over for fallout details at each stage.
Start: 2022-01-23 to 2022-01-29.
Last 7 days funnel performance Hover over for fallout details at each stage.
Start: 2022-01-30 to 2022-02-05.